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ABSTBACT 

*\ The Lincoln Terminal /System is described as a device 

ir:.th the capability to deliver technical information, to nqnitor 
s :adent performance, and to assure learning in industrial training, 
vjme experimental^.hardware and tte lesson material for the system were 
^^ested in two mi^e maintenance schools and the results show that: (1). 
student users of the system improve^ substantially on tests; (2) 
students found the material and th^ means of presentation acceptable; 
and (3) supervisors we'^e favorable ^o the use of the system. Sine . 
training ins-tructors will proceed t'o format instructional materials 
for computer instruction. Field tesjb results and sample lessons are 
provided. (EMH) 1 
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DISCLAIMER NOTICE 



The views and conclusions contained m this document * 
are those of the authors and should not be interpreted^ 
as necessarily representing the official policies or 
recommendations of the Interior Departm6ntV^^Btireau 
of Mines or of the U.S. Government, - X'^^ - 



. - , f;oreword 

This report was prepared by, Massachusetts Institute of Technology, 
Lincoln Laboratory, Lexingt6n, Massachusetts 02173, undel- USBM 
Contract Number HO346079, The contract Was initiated under' the 
"Coal Mine Health and Safety' Program. It was' administered under 
the technical <iirection of^PMSRC with Mr. James C. Ault acting as 
the Techn'icarProject Officer, Mr- :^^ichael W. College was the 
contract administrator for the Bureau of Mines. 

Th^s report is a summary of the work recently completed as partipf 
thi^ contract 'xluring the period 1 July 1974 to 1 August 1975., This 
report was submitted by the authors on 15 Julyfcl975. ^ 
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LINCOLN LABOrSaTORY LTS-3S TRAINING SYSTEM: 
APPLICATION TO TEACHING ESSENTIAL MINING SKILLS 

t 



L SUMMARY AND RECOMMENDATIONS 

The Lincoln Terminal System is described as a device with the capability to deliver technical 
information, momtor student performance, and assure learning in industrial traimilg. An exper- 
imental umt, the LTS-3S, was constructed and delivered to the Bureau of Mines with appropriate 
lesson material for a test of feasibility and acceptability of this form of training in the mimng 
environment. Operations were conducted at two mine maintenanc.e schools. The overall results 
were that (1) there was a substantial improvement between tests before and after self-traimng 
on the LTS, (E) students found this an acceptable way to learn, and (3) reaction by training per- 
sonnel and supervisors was favorable toward the feasibility and advantages of using the LTS in 
the mining environment. , Transfer of the LTS to industry depends on availability of reliable units 
and- adequate lesson material. 



aid^^r 



The requirements for authors of trainfl^materials were established based on advice from 
mine traimng experts, formal analysis of lessjn dev;.lopment procedures,^and experience from 
efforts in lesson development at Lincoln Laboratory. It was concluded that experienced mine 
traimng instructors were best qualified to proceed effectively and economically to format instruc- 
tional material for the LTS, if supported by well -designed facilities and services. Discussion 
rtith milling experts confirmed the desirability of generating training materials and delivering ^ 
instruction at distributed locations to meet local training needs and in direct support of industrial 
operations. . ' ' ^ 

It IS recommended that a phased program to transfer LTS technology to the mining industry 
be implemented as follows: 

« » 

(a) Complete the design development and specification of a reli^le and * 

economical terminal suitable for commercial production {LTS-5). , 

(b) Develop and program an extended^ terminal (LTS-5X) that will give local ^ 
authors : 

(1) Instruction on LTS lesson design methods and techniques. 

(Z) The capability to create a logic file and to run lessons 
on the machine in a simulated mode.' 

(3) Vhe capability to accept and display student performance 
data recorded at LTS-5 terminals.* 

(q) Conduct tests of the LTS-5X lesson development, support functions at one 
or more training sites and use phe results to perfect the design prior to 
release. 

(d) Complete engineering development of the microfiche production facility 
with procurement specifi<jatio«# ( 
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Ih INTRODUCTION 

This IS the final report of a one -year effort under a contract with the U. S. Bureau of Mines 
to determine the feasibility of application of the Lmcoln Terminal System (LTS) to tfaining in the 
mining industry. Thp ma>or efforts under t^e contract were: 

Construction, documentation, and delivery of an LTS-3S model 
instructional unit to the Bureau. 

Development of prototypical lesson material on mine safety for 
the machine. 

Demonstrations *a^arious sites and a formal field trial of the 
concept in mine maii^enande training schools. 

I Site visits, discussion^^xh instructors and training supervisors, , 
and research on thejiPolSltems of training facing the industry. 

This report is the fina/outcomeprthese efforts. It attempts an orderly exposition of new 
findinjgs and specific recoiA^nen^arCions to assist in transfer of this new technology to the mining 
industry. 

m. THE LINCOLN TERMINAL SYSTEM (LTS) AS AN INSTRUCTIONAL UNIT 
FOR TRAINING ^ , ^ 

The purpose of using the Lincoln Terminal System for training is to provide a degree pf 
automate^ instmctioa to enhance the rate and quality of learning.. In a typical training siMation, 
students differ widely in l.earmng skills and background. As a result, presentations to gnbups 
in the classroom often move too slowly for some students and too rapidly for others. If f tudeilts 
are handled on an individual basis or a few at §i time by the instructor, those not rece/viig atten- 
tion often are not fully occupied. Trainees can learn to some extent on their own, but: m my times 
they must have individual help. The help they need depends on the kind of mistakes they make, 
and in the school i^e instructoj: is the only means available to diagnose learning difficult r and 
give proper remediation. Mine maintenance traiiUng instructors report they are overlpj ded and 
have trouble giving adequate attention to individual problems if the number in a class exceeds ten* 
The purpose of the LTS as an instructional unil is. Co reduce the load on the instrutflor by asing 
the machine not only to conveyjinformation but also ffo interact with the individual student to\elp 
him to solve problems he encounters in learning. Iflthe dependence of the trainee on the instjruo- 
tor can be reduced in this way, two benefits will occiu*. First, the number of students served 
by one instructor can be multiplied by two or three times. Second, the instruptor's attention 
can be devoted to the students with the greatest learning difficulty and to the teaching of skills 
that cannot be delivered by machine. The goal is to exiend the number of students an' instructor 
can handle and to improve the overall quality of the results. 

Machine -supported learning to be effective must include display of detailed information, 
diagnosis of student learning difficulties, and branching to prpper remediation. More specifi"? 
cally, it must be able to convey technical information duch as drawings, photographs, diagrams, 
data, text, etc., in considerable detail. It must be able tc^ present problems to the student, 
accept answers, diagnose errors, and branch to remedial material which is appropriate to th^ 
kifld of error made. A typical strategy for using a machitife of this kind is to deal with a new 
topic in a tightly related set of frames. (A "frame" is a siiigle audio/visual display either 



of information or of a problem of some .kind.) Usually, ne^v information is presented in one frame 
of Spring of several successive ones and on the following frame understanding of this information 
IS tested* The test must be a fairly difficult one in which guessing is unlikely to produce a cor- 
rect answer by chance. If the an&wer is correct, learning is Assumed to have occurred and the 
trainee is directed to a new topic. If some failure is detected, he is moved to new remedial in-: 
fgpfnation appropriate to the specific kind of mistake. For example, the error may indicate that 
the student needs to review old material that he was supposed to have already mastered. Or he 
may need an expanded or alternative explanation of a new-^opic with which he is having difficulty. 
*When he is done with the remediation, a test is given again, and if successful, the student then ^ 
goes on to the next topic. If, however, failures are repeated, he is told to "Go find your instruc- 

^(or* or bbtam help froth an outside source such as reference materials. The Appendix presents* 
an example of this fo^ of training. The training technique of the LTS is extensively plustrated 
there, and it is 'suggested that the reader take time at least to scan through it. 

It has been demonstrated many times that this method of training is highly effective. With 
adequate lesson materials, students can progress rapidly on their own. Compute^r terminals, 
along with printed or photographic supplementary materials, have proved effective in instruction 
m computer maintenance, principles of electronics, .dentistry, etc. The Lincoln Terminal Sys- 
tem (LTS) captures the same training capability in a stand-alone machine which is far more 
versatile and less costly than one based on conventional computers. Each LTS unit - one per 
student - has both the data processor and audio/visual information built in. Two of its capa- 
bilities, to produqe detailed visual images and to deliver a 20 -second audio message with each 
display, are not found in computer systems. Although not always essential to learn^g, the audio 
feature enhances lesson delivery in a number of ways. Voice has the overall effect of lending a 
human quality to the machine. It pan be used for emphasis, warnings, and to reinforce^Jearning. 
It also pi'bvides an alternative channel for communicating with the student who ha^ difficulty with 
reading, And finally, a student listening to audio with earphones is blocked off from noise dis- 
tractions in his environment. Other media such as sound/slides, motion pictures, and TV have 
a sound-track capability. These are linear, however, and there is only one path through the 
material. With the LTS^n the other hand there are many paths, one for each student determined 
by his record of specific successes and failures. The audio as well as the visual presentation is 
arranged to meet his particular need of the moment. This is" called "randoiri access" displays; 
the presence of random-access audio is unique to the LTS. Students respond very favorably to 

^"th3^ feature, and it is our conviction that the presence of random-access audio substantially 
extends the range of students who will succeed in this form of training. 

T*he LTS realization of automated training has been demonstrated as effective in a l^rge 
study supported by the U. S. Air Force. These results are summarized in the next section. Under 
the contract, a field test of training mine mechanics has also been completed. These new results 
are reported in the following section. The purpose in both studies wa3 to determine (1) if mas- 
tery of the material is achieved, (2) if learning proceeds with little dependence on outside help, 
and (3) if this form of training is acceptable to the ^dents. 

IV. FIELD TEST OF THE LTS CONCEPT IN THE U. S.*AIR FORCE \ 

An extensive study^ was conducted at the School for Applied Aerospace Sciences at Keesler 
Air Force Base in Mississippi. Lessons were prepared for the L^S covering the sixth week 
of the Basic Electronics Course, normally 30 .hours Of classroom and laboratory instruction. 



The subject matter was series and parallel RCL circuits, and ^he authors of*the lessons were 
military and civilian personnel at Keesler, The hardware system was one that wai^.yery similar 
in operation to the present stand-alone model, altha\j^h fiv« terminals shajje^a minicomputer 
rather than each having its own processor, (Under the "R^esent contraci;^, one of the'electromcs 
lessons ^as converted to the newer ma^liine. The conversion process was.iiot difficult, and the 
resultant lesson was virtually identical to the original.) The principal findings for the initial 
experiment on 55 students were as follows: ^ ^/ 

Mastery of the material *was as complete for LTS students as for a 

A' 

matched control group in the regular classroom, { * 

^here was a 37 percerjt savings in learning time when compared ' ^ 
to th^tipae (30 hours) allotted for classroom delivery. 

Students spent an average of less than 2 percent ojf their time ♦ 
receiving he^pftom their instructor, ^ 

The trainees-expressed a very positive^et of attitudes toward this 
V ' • " 

/orm of training. 

The students were selected from a group that^ell in the 80 to 96 percentile qn a test of elec- 
tronics aptitude and Ijad 12 years of prior education on the average. Twelve of the lessons 
presented electronic principles, involving problems of circuit analysis,' selection of a formula, 
and algebraic calculations. There were two other lessons that showed the student how to hook 
up bench equipment to test empirically tjie operation of the^ circuits,, T^ lessons covfered theory 
^rather than application, they differ, for^^examplef from the material in the Appendix wliich deals 
with electrical practice and the Law and^very little with principles of electricity. Under thepe * 
circumstsinces, the LTS proved to be an efficient, effective, and highly acceptable meafis of 
instructional delivery, ' . 

A continuing series of experiments provided additional results, ^9me students were trained 
itk pairs, working through the material together but tested separately, they moved as rapidly 
and performed as well on the test on the average as singles. High-aptitude students in the 96 to 
100 percentile also ran on the LTS and l>enefited markedly both in terms of reduced training 
tii^ie^and improved test scores, A reviejy of findings based on about 200 trainees on the LTS ^ 
show&sthat the slowest students seek help from an instructor and i^ake longer on the lessons 
than mightbe expected. Apparently as a direct consequence, the number of trainees who failed 
the final test, Reading to a "wash back" in the course, was reduced by about 50 percent. This 
result suggests tlmt indeed training with the LTS tends to give the most help to students with the 
. greatest need. 




V, FIELD TEST OF LTS-3S IN MINE TRAINING SCHOOLS 



There was every reason t^suppose that the LTS would be equally effective at traimng mine 
mechanics as it was for electronic technicians. But the students, the objectives of the schools, 
and other factors were sufficiently efferent to warraW a demons t rati pn of its potential, and so 
a field trial was initiated under a conti^t for the Bureau of Mines, Four lessons were prepared 
by Lincoln Laboratory on mine safety, serving a primary mission of the Bureau of Mines, The 
subjects included the nature of electrical Im^ard and the meaning of the, Mine Safety Act of 1969 
as applied to problems of elect|*ical grt)und. The goal of training in this instance is to impart 
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the kno\vledge which n^ine mechanics must have to perform in a safe an4^proper manner. The 
purpose of the study was. (1) to prove that learning of such material doe's occur using" the LTS, 
(2)* to assess studepl acceptance, and (3) to gather opinion and comment from instructors and 
their supervisors on the potential of this ne^^#fechnology. . 
The lessons developed fpr this test included: 

(a) Man as a Conductoc^of Electricity : an explanation of shock hazards , 
and their effects on the human body. 

(•b) SPlid Grounds : connections to earth, system and frame grounds, • 
' resistance grounding. * -^"^ 

(c) The Law and Grounding: review of Parts 7 5 and 77 of the Law 
relative to grounding covering lovv-, medium-, and high-voltage ' 
circuits. " * * ^ ^ « 

(d) Problems* in Grounding: electrical connection of a piece of mine \ 

> ^ ^ 

equipment to^^a source of power is made by the student, and viola- • 

tions 9f the provisions of the Law are detected and corrected. (The 

Appendix shows in detail part of a problem from this lesson.) 

Each trainee was given a test before instruction, worked on his own for about 45 minutes on one 
or two lessons, was giveft another test, and filled out a. brief questionnaire on the experience! 
Training was conducted at two sites in Pennsylvania, the mine maintenance trainipg school of ^ 
the Jones and Laughlin Steel Company near the town*of California and the Admiral Peary Voca- 
tional and Techmcal School dX ^ibensburgh. Students from these two schools, as well as trainees 
frpm the Barnes and Tucker Coal Company, participated in the tests. Two LTS-3S eixperimentaji 
delivery units were used, the one delivered to the Bureau under ^he contract and a second one 
assigned by Lincoln for the test. . The Bureau machine was transported by truck in an impact- 
cushioned crate, and the Lincoln unit rode uncrated in a passenger van. Transport in either 
mode seemed to have no adverse effect and the setup time for a machine was le^gs tlian one 
half hour. * * ^ 

Eight students were able to finish only Man as a Conductor in the time allotted, they were 
younger, less experienced students enrolled at the Admiral Peary Vocational School. Each of 
the experienced miners, from the Jones and Laugljlin and the Barnes and Tucker maintenance 
training classes, was able to complete one of the other lessons as well, five finished Problems 
* . m Grounding and nine Methods of Grpunding ^ (The fourth lesson. Law and Grounding , was in- 
tended as a review for highly experienced mechanics' and electricians and thus was not used in . 
this study.) The test beforehand covered all four lessons. The Admiral Peary students scored 
43 percent on the average on this test and the experienced miners 58 percent. Tests were 
scored for questions on material actually taken to measure progress du^ to learning on the ma- 
chine. Table I shows scores before and after the lesigons for each group. Impro^verjment from 
11 to 14 percent over the three groups indicates that substantial learning did occur even in a 
period of tirtie of less than one hour. * ♦ 

The acceptability ctf .this form of training is reflected ir> fit brief questionj;iaire given at the, 
end of the learning session. The questions and the frequency 6l i*esponses are shown in Fig. 1. 
All students agreed on the first question that the difficulty of learning was "just right," despite 
the fact that the less experienced students were able to finish only one lesson in atOut three- 
fourtl^s of an hour and the more experienced two. This is indicai^ive of how successfully LTS 
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SCORES IN PERCENT BEFOKE ANDf^AfTER ITS TRAINING 



lAssons Taken 



Man as a Conductor 

^,Man as a Conductor 
Problems in Grounding 

Man as a Conductor 
Methods o( Grounding 



Score Before 



50 
72 

• 55 



.Score After 



63 
83 



69 



Change 



+13 
+11 

+14 




1) How difficult was learning on^e machim 

too tough 25 just ngh: 

2) Would you rather learn this material from a boolc 

ye s 2 maybe 

in tHe classroom? 

ye;? 9 maybe 

from a film? 

I— yes 8 maybe 

3) Was the voice of thennachine helpful? 

never H sometimes 

4) Did you ever have trouble putting answers in the keyboard? 

11 never 14 sometimes 

Fig. 1» Questions with frequency of answ( 




14 always 



. alwa^ 




ti^aining adapts to individual learning needs, the response to the first question seems to show 

that trainees recognize anji appreciate this feature. In the second question, no students prefer 

learning from books, but some prefer classroom learning or a film or TV presentation. There 

'is fluite a spread of opinion. Perhaps to some students, the phrase "Would you rather learn*' 

means "Would you find it less demanding", in yjaHT^^tBe, preference for sitting in^a class or m 

front of TV would be expected. The responses to the question on voice are typical - learning 

without the voice would be entirely possible but students usually say it is very helpful.. As to 

the last question, students always find the LTS easy to use, but some expressed that they had ♦ 

difficulty due to minor equipment problems encountered with the experimental apparatus and to 

a few flaws in the new lesson mater iaU 

Attitude surveys and comments from students who learn on computer training systems and 

on the LTS have always been very favorsfble. Here, there was less than an hour of trainihjg, but 

in the Air Force study ^ students responded favorably even after 8 to 30 hours on the system. 

2 

The longed duration for continuous trainmg m this form seems to be a Navy study involving 
many weeks of computer-ass i&ted training, six hours per day and five days per week, and it 
showed no decline in either performance or enthusiasm. A favorable attitude is obtamed evpr* 
after the novelty of this kind of training has worn off. 

To summarize, the leai^ning performance on LTS reported here, taken in conjunction with 
other findings, suggests that this form of training will likely increase the speed of learning and 
assure mastery of the material for mine mechanics arid* will be highly acceptable to this kind 
of trainee. The implication is that trainees can acquire technical knowledge largely on their own 
and depend much less on instructor support. Some advantages of the LTtf that capitalize on this* 
potential as a hieans. of, deli very are discussed in the next sectiph^ 

VL APPLICATION OF LTsN^O MINE TRAINING , ^ ;^ ' \ ' 

As part of the contract, po/sonnel from the coal companies, ^he unions, MfiSA, and the 
Bureau were contacted and surface and underground mjning operations were visited-in order to' 
gain first-hand knowledge of the problems in mine training as they relate to the LTS. It was 
pointed out that this is basically a machine for instruction inlets, procedures, principles, and^ 
other skill knowledge. It does not, for example, teachl eye -hand coordinatiqn and as a result is 
not appropriate for training operation of controls on m:mng equipment and similar applications. 
All personnel, however, are responsible for learning £ afipty and must have knowledge about the 
Mine Safety Actf safe methods, and procedures. Furthermore, the demands for betier under- 
standing placed on maintenance, repair, and supervisory personnel is increasing as tlie number, 
variety, and complexity of mine hiachinery grows, ne^^^echnology is involved and new knowledge 
is required to cope with it. The general impre^sipn wis gaine^hat meaiiy for increasing skill 
knowledge of miners, mechanics, electricians, and supervisors is in universal demand, and 
if it could be met the safety and productivity of coal operations w^uld benefit greatly. 

The time -honored method of on-the-job training, the apprentice guided by a journeyman, is 
no longer feasible because journeymen are not well equipped to instruct, and costly operations 
cannot be halted while time is taken to indoctrinate a new person. To a considerable extent, 
industrial training responsibility lias shifted to central operations such as VoTech, commercial, 
and military technical schools. Although the large school is efficient, this kind of graining is 
^ often incomplete and graduate's are by no means fully prepared to p,erform a job^, Th^ job re-* 
quirements at different sites vary tremendously with respect to equipments, procedures, and 



the work environment, and a central school cannot tailor each student's program differently An 
preparation for his specific job circumstances. Another factor is that a broad range of topics 
is covered in long courses of training, and there is mxich forgetting between the time of original 
learning and application in the field. Often in industry training is conducted close by the indus- 
trial operations. In mining it is done at the maintenance shop, the portal,, the mine office j etc. 
The LTS has the flexibility and versatility to adapt to an operation close to the mining site/where 
it is possible to structure training as an extension ^Jf regular mining operations. There it can be 
tailored to specific equipments, local procedures, and immediate needs, and what is learned 
can be applied to the job before it is forgotten^ '* l^*^ | 

There are other forms of technical aids to individual instruction that are effective but none 
have the versatility of th^ Lincoln terminals. The efficiency of individualized instruction, i.e., 
managing each student's learning separately, was revealed by training research in the IS 60s. 
It was found that the digital computer was the most effective means to manage the learmr g; proc- 
ess on an individual basis. It proved an expensive arid often cumbersome way to train, how- 
ever, and as a result has been used only on a limited scale. Computer charges are high and the 
detailed visual displays required for technical subject matter cannot be stored and retrie ved 
economically by electronic means. Access to la^rge mass memories is likely to remain costly, 
with communication cljarges to users at distributed locations perhaps even increasing with 
increasing demand. In the area of processing though, a truly significant new electronics devel- 
opment has occurred. It is the^ microprocessor which pei^mits each user to have his own com- 
puting power instead of being coupled to a large machine and sharing it with others. Micro- 
processors are becoming cheaper and more powerful every day. As a consequence, in many 
cases it is more economical to have a complete data processing capability in each terminal 
than to pay communication costs to a central machine. In thia case the, terminal need be tied 
to nothing but an ordinary sourpe of electric power. Presently available microprocessors have 
the capability to manage leSirning but, like computers,, do not have the memory to support detailed 
visual displays. These may be handled "off-lin4," as theyiiave in several experimental computer-- 



based system^, iq the form of text, slides, and other conventional media. The handling of les- 
son materials separately is unwieldy ho>vever,« and so the LTS incorpotates not only its own 
microprocessor to manage and monitor student learning* but also' it^ own microfilm store of 
thousands of visual images. It combines th^ advantages of computer processing with mass in- 



\ 




formation store on film in a sin^T integrated unit. Because it operates in stand-alone fashion, 
it is practical to administer "instruction at distributed and isolated sites, such as those in the 
mining industry. ^ ' 

The present experimental model of the LTS appears to have a more than adequate capacity 
for mine training on-pite or in a school setting. If this new technology is to be m^.de widely 
available, it will be gecessary to develop a commercial source of equipment and facilitate the j 
development of instructional materials. These matters are considered in the following sections 

vildthe lts-5 productioi^ prototype 



a n^ 



A production prototype (LTS-5) design is shown in Fig; 2, At the left is an 8-1/2 X 11 
black-and-white projection, a photographic image of a very high quality that may' appear ir> 
a1hrbj[rizontal as well ae vertical orientation. With each picture, there is up to 20 seconds of 
audio available by headphones or loudspeaker. There is capability to acqept commands and to 
interpret answers to questions that are entered on the keyboard shown at the i;^ght. Numbers 
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• Fig. 2. LTS-5 proposed design- 

entered on the keybosurd appear on a small display above the keys. Student responses are inter j 
preted by the machine, and appropriate branching to a ne\^i audio/ visual frame occurs. These — ^ 
capabilities represent a system that should be adequate to serve over a very wide range of skill 
knowledge traimng. For reasons of ec6nomy and for improved reliability and maintainability, a 
number of non-critical features were not included in the design. , « ' / 

Some features of media may be used to enhance motivation, thu&, color, animation, and the 
like are used in attempt to sustain ihtf rest. They may be important in conventional classroom 
instruction where the pace is set by the slower J^arner, bu*i^ey are much less significant in a 
system like the LTS where the student is continuously chaltet^d and the pace is always "just _ - 

right." Self -pacing and the fact that the student is held accountable for learning at regular 
intervals largely eliminates the need for external, artificial devices to attract and maintain 
attention. There are a variety of aids to understanding that might be added to a teaching ma- 
chine, such as motion pictuM or computer-driven dJusplays, recognition of i^ords as inputs, * 
simulations aind games, b<c. These add to the cost of the units, complicate maintenamce, add to 
the cost of lesson development, and make the terminal more complicated for the student to use. , 
As motivational aids, they are i)ot required and they are seldom essential for technical training. 
Therefore, it does not seem cost effective to incorporate, them as standard features*?or a pro- , ^ 
duction LTS terminal. Other multi- media and computer devices can be used in conjunction with j 
the LTS, if they are in fact required. Two featu^gfi^pear to be desirable options for later con- ^ 
sideration,. full-color visual projections and a capability foV the student to express his selection 
of objects on the visual display merely by pointiitg to them. Each appears feasible but engineering 
development is required. - 
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The.LT6-5 iS designed to be aj^jsffective unit to deliver instruction within the wider context 
of a sysiem o*f training, TheJ)a€ic medium is a 4 x 6 -inch film card with 12 audio/ visual frames 
per card Up to 750 caryi^re loaded at a time in a carousel in the terminal, 9000 frames in 
alL, This representj&m least 100 Hours of instruction, ^ind reloading with new material is a 
simple operatiop* When a frame on a different card is selected, the carousel rotates to a new 
card, tandj^is loaded into a gate. The capd is moved in the, gate to one of the 12 audio/visual 
imag9 iJairg and the gate is closed.^ Frame -to -frame time is from two to five sedonds. There - 
are two p;:ojection lenses, one for the visyial and one for audio. The visual image is projected 
to^the screen. The audio image in the form of a width-modulated spiral sound tracfk is projected 
to an optical scanner and audio sensor, a kind of optical phonograph. The' function^ of the ma- 
chine are shown schematically in Fig. 3. The student views the screen and listens t6 the audio. 
The onset of the audio is delayed by a few seconds while a small burst of digital data (shown as 
a dotted line on the spiral) is fed to the processor. When the student reacts to fhe frame by 
pressing keys, ^ the digital data are used by the processor to interpret the inputs and to select 
the next card/frame location* The student enters numbers to answer questions if called for, 
and they appear right above the keyboard on a display like those in pocket calculators, then he 
presses GO-ON and the processor interprets the inputs and goes on to the next appropriate frame. 
He also has options to CLEAR the display, REPEAT the audio, call for HELP or an INDEX, go 
BACK, and so on* Both interpretation of ^mswers to questions and the other options are con- 
trolled by the data at the start of the audio spiral, the "frame logic" specified by the author for 
each frame in the lesson. Some inputs m^ not be legitimate on a frame, and a red light is 
turned on to mdicate to the student to try agaiil^ Otherwise, a new card is Selected if needed and 
a new frame and the cycle' is repeated. 



UNCOLN 
TERMINAL 
SYSTEM 




Fig. 3. Schematic dr&wing of the LTS Instru^^tional Delivery Unit. 
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A separate contract between LincolH Laboratory and the^Bureau of Mines covers engineering 
development of the LTS-5 prototype, and procurement specifications are expected to be available 
in late 1976, * . 

\ * 

Vm. THE LTS LESSON. DEVELC^PMENT P^IOCESS 

The effectiveiiess of LTS instruction depends vitallV the quality of lesson material. 
Because the^ whole learning process is managed by the lesson, the materials are more difficult 
to prepare than conventional text or descriptive matter. In the classroom, the text carries only 
part of the instructional load. Whatever techmcal infoi^^m^tion may be lacking is added by the 
instructor, and he carries the responsibility to hold each student accountable for learning. On 
the LTS, the lesson itself must be completely informative and monitor student progress if in- 
dividual learning is to be sustained. Realizing the full potential, of th^ LTS depends on finding 
efficient ways to produce such material. - ^ 

, There is first of all the need to find auth6^s. The majOr qualifications, for authoring are to be 
a subject matter expert, to have relevant job experience, and to have practiced the instruction of 
individuals or small ^^^^^^ preparation of materials for the field test in mine safety training 
revealed the inefficiency WMji sing authors who are neither expert nor experienced in mimng to pre- 
pare lesions. More than half the cost of developing the lessons was incurred in educating^ the 
authors about mining in generail, electrical hazard, groimding circuitry, and the Mine Safety Act 
Even so, when the material was reviewed for approval b^ the Bureau personnel, some misunder- 
staftdings in content had to be corrected and certain details were pointed out as unresHistic and 
possibly misleading. The resultant lessons were entirely satisfactory, but if the authors had had 
expert knowledge and experience from the start, the process would have been more efficient. 

Design of lessons also benefits greatly from th^ kind of good judgment that is based on ex- 
perience in teaching. On a quiz frame in a lesson, there are usually many more kinds of errors 
than it IS feasible to deal with, the author must be able to anticipate the likely and significant 
kinds and remediate just those. The obvious conclusion is that the best candidate for authoring 
is the training instructor, typically he is an expert in his subject, he has practical experience, 
and he has proven capability to cope with individual learning problems. Perhaps it is not top 
great a simplification to say that the function the LTS performs is to capture the expertise of the 
instructor as well as technical information in a machine and to deliver it later to students at 
convenient time's and locations. ^ 

Most efforts to use instructors to prepare materials for automated training systems have 
faltered badly because they have assumed that authors must learn computer {echnology, princi- 
ples of individualized instruction, or some other Cairly complex art. In the Air Force study (re- 
ported in Sec, IV), a number of factors conspired to force simplification of authoring procedures. 
LTS was conceived from the start as having very limited data processing capability, although 
with the advent of microprocessors since that time this constraint no longer holds. There was 
a limited amount of time to prepare the system an^ to train the authors. Finally, the authors were 
located m Mississippi and the system designers in Massachusetts, a separation of 1400 miles. A& 
a consequence, the procedurel^ for using the processor capability of the LTS, the aspect of the 
LTS these authors were unfamiliar with, v^ere greatly simplified. The instructor -authors were 
offered fiVe standard methods of fielding student inputs on a frame. They constructed a looseleaf 
notebook with a page specifying the elements of each frame in a lesson. The visual and audio were 
specified, and the author chose one of the five standard methods for handling student responses. 
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He filled out a table for each frame of what has come to be called the "frame logic,** showing the 
kinds of erroneous ):*eSponse that could be expected and identifying a frame to go to for each kind 
of error. The lessjjn notebooks were sent to Lincoln Laboratory for editing and conversion to 
LTS. The lessens developed proved to be effective as the results of the study show. It was a 
major discovery tKai experienced instructor's require little additional traimng to produce effective 
'.rtiaterials, given simplified procedures and adequate author support. 

Although Lincoln personnel made po substantive changes in the Air Force lessons, it was 
' troublesome to .edit the lessons and to remove minor flaVs and logical errors. One source of 
difficulty was that it' was not always easy to determine the author* s intent, there are some error© 
that can only be riemoved by the author himself. Moreover^ errors of this kinji were often not 
apparjent until the lesson was converted to film cards and could be run on LTS. * To do a complete 
job of editing, it is necessary to observe how fraipes relate to each other in operations as ex- 
perienced by a student. The actual process of converting lesson material to film is not expensive, 
and tjhe itiinimum turn -around time is pnly one or two days. Unfortunately, the real delays in 
getting a revised card are longer and during busy periods intolerable. The details of a particular 
les^n design essential to editing are easily forgotten.. In response to the difficulty m finding 
errors, a breadboard checkout facility was implemented that permitted simulated runmng of a 
lesson before it is committed to film. 

!' To. check out a lespon on this facility, first a lesson logic file is created. The logic is in- 
serted for each frame, in the same manner as entries are made in inventory control and other ^ 
autoni^ted business systems. The user begins the simulated run by openmg the lesson notebook 
to the first frame, looking at the visual, and reading the audio. He responds through a keyboard 
like the one on J^TS as if he were a student talahg the lesson. The response is processed ac- 
cording to the frame logic for that frame. Hov ever, instead of selecting a new card and frame, 
on film, the page number of the next frame in the notebook is displayed. The user turns to that 
page and the process is ,repeated. In this manner he can proceed through the entire lesson much 
as if he \vere at a real LTS delivery unit. This facility was first placed in operation in editing 
the mine safety lessons. ,It has proven effective not only to remove technical flaws by an editpc 
but also to permit authors jthemselves to evaluate their lessons as students experience them. 
Authors at Lincoln have been able to make major improvements in their material with thi§ facility 
and have come to depend on it as a tool of good lesson design. , 

The present checkout facility at Lincoln is a breadboard version, adequate when used by 
technically sophisticated personnel. Our experience suggests that with some development effor^t 
it would be possible to engineer and document a practical facility for local checkout of le^ssons 
that would not require technical sophistication to ihin and riot impose a very substantial added 
burden on the author/instructo;* as a user. Given access to this, facility authors would retain 
firm control of the lesson design. and have the capability to evaluate their lessons in operation 
either by themselves, or by trainees fed to revise them accordingly. On-site capability of this 
kind will add substantially to the efficiency of lesSon development. 

Initial investigation indicates that it would be feasible to extend the LTS-5 to provide the 
additional capability to create a logic file for a lesson in the machine, to run it in simulated 
mode, and to display notebook page numbers in glace of frame selection on the machine. The 
LTS-5 has an optional capability to record student performance data, and the extended version 
of this m^achine, the LTS-5X, would also have the capability to sort, combine, and display these 
results in order to evaluate lesson development. Except for a small unit to mterface the checkout 
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facility to the LTS-5, the necessary equipment is available as commercial hardware components 
and wouid no more than double the cost of a terminal. Alsingle LTS-5X could serve a number 
of authors, and it would ^em attractive to have at least one at even small training schools to 
enhance training effecti^ness. It would serv§ to generate new material, to speed up the revision 
and_ update of existing ijiatenal to help insUte that lesson content is matched to local conditions, 
procedures, and equipment, , ^ 

Once a lesson hats been developed in notebook form, checked out and revised, it is ready for 
the materials to be^^inished in preparation for conversion to film cards. The frame logic file 
preparied for final lesson checkout is the same one used in the production film cards. The audio 
is generated by the author himself, first in ^ritten form and then on conventional audio tape. ^ 
Most authors are at first reluctant to record their own voices, but the results are in fact usu^iUy 
♦very satisfactory. A variety of voices over different lessons lends interest, and the author, 
unlike a professional talker, always knows exactly where to apply the proper emphasis. Audio 
cam be recorded on any good commercial machine, and a tiape is sent along with the notebook 
for transcription to film. Unlike generation of logic and audio, the drafting and finishing of 
artwork is a relatively time-consuming and expensive part. of lesson development Jt is not un- 
common for 50 per<:ent of the effort in developing a lesson lo go into the visuals. Because the 
LTS IS based on the film mejdium, it is especially economical to use photographs and to copy \ 
Existing materials., Otherwise, the cost and .methods of preparation of original copy are much 
the same as for printed materials. Lincoln used commercial artists to produce finished mateifials 
for some of the mine safety lessons with considerable success. J 

The firml process of ^repjroducing: finished materials on film is straightforwarid, and relatively 
inexpensive. In the expenmlental system at Lincoln Laboratory, cards are produced at an oper- 
ational cost of about $50 per master and $0.2S per Copy. AH lesson specific information is 
contamed on the cards, this provides a singly, highly econo6iical medium for the production, 
copying, dissemination, storage, and revision of training material. The components of the film 
card production system are commercial units with the exception of the machine to producg audio 
spirals. For this technology to be transferred to. industry, there is a need to develop a production- 
engineered umt to convert audio and logic to film spirals, to make other hardware improvement^, 
and to document the system m detail both with respect to hardware specification ahd operational 
procedures. This would permit^commercial services to adopt the technolo^ and 'to support 
finishing, conversion, and distribution pf training materials. ' ' ^ ^ ' 
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APPENDIX 

A Student Learning ^Ixperience in the Lesson 
Problems jn Grounding 



The following frstmes a^re taken from the lesson, Problems in Grounding. In this lesson, 
the student makes legal connections* between motors, power sources, and ground. Little under- 
standing of electrical principles is required, but the student is held strictly to account for 
grounding equipment legally. We will follow a student as he makes various ferrors going 
through a part bf this lesson. 

First, the student is given a problem to be solved. He is shown a llOV AC motor mounted 
on a water pump m an underground mine, a power distribution Center containing several types 
of power supplies, and a grounding field. ? In the audio he is told, "Make all the necessary legal 
connections between motor, power supply, and ground." After connecting the* motor to a center- 
tapped llOV AC supply, he presses the GO-ON key on the keyboard shown below. This takes 
him to the frame at the top of the next page. 
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His job is to connect the system ground. He can do one of several things. It the system does 
not have to be grounded, he Just presses GO-ON. If a system ground is required, he indicates 
where the' connection is made. Eight terminals are labeled and a connection is made by pressing 
the proper pair of numbers on the keyboard. . ' 

. Ignoring the instructions-, he enters 1 and 2 - just to see what will happen. The only thing , 
that does happen is that the red light on the keyboard turns on, indicating a nonsensical answer. 
Finding the right answer by guessing is impractical even if he follows the directions. There are 
only two chances in fifty-seven that the correct answer will be- chosen by chance. 

Obviously, to answer this problem the student must know what to do. In particular he must 
know the federal regulations* To help him with this, a hote in the tottom corner of the display 
tells him to press the HELP key. ^He presses HELP and goes to the frame at the top of tho- ^ 
next page. .* ^ , * 
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Here .he is shown two pages taken from the Law. The audio says, "Find the section of the 
law that deals with your problem. ^ Read it thoroughly and press *G0- ON,"/ After finding the 
section,^ he re^ds it, then presses the GO-ON key* * 

This takes him back to the same frames as before because afte reusing the HELP key, the 
student is always returned to the plape in the lesson from which he came. 
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Again he is told, "if a system ground is required, you should connect the system gi«ound. 
If not, just press' GO-ON." Not understanding what k system ground is, he eijters 3 and 2 - 
connecting the equipment fK*ame grou nd. 

Of course this connection is neaded befpre power can be turned on, but he has not followed 
the instructions on therframe. This error takes him to a definition of system and equipment 
groimding'* t ' * ^ 
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DEFINITIONS . 



Jht word 'Grounding' is commonly used in 
ettctric power system work to cover boti) 'System 
Grounding' and 'Equipment Grounding/ ^ 

System Ground; A System Ground Is o 
connection ^o earth from one of the current 
carrying conductors of a power source. 

Equipment Ground: An Equipment Ground 
is a connection to^eorth from oife or more of 
the noncurrent-^carrylng metal ports such os 
metal conduits, metal armor of cables, 
outlet boxes, cabinets, switch boxes, motor 
"frames, and metal enclosures of motor 
c\:>ntrollers. 
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"You seem to be confi^sed about the difference between 3ystem grounds and equipment frame 
grounds. Syste^m grounding is the grounding of a power source. Read these definitions, then 
press GO-ON to try it again." He reads the definitions, realizes his mistake, and presses 
GO-ON which returns hiin to the problem. 
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Again, back to the'^same frame; "If a system ground is required, you should connect the 
system ground, If not, just press GO- ON," Whenever the student wants to hear the audio 
message for a second time, he presses REPEAT. He is uncertain so he presses the REPEAT 
key ctnd listens to the instructions again. Now he understands the instructions and presselb 
GO- ON, indicating that no system ground is required. 

This takes him to a frame showing the section of the Law dealing with grounding of 110 V AC 
systems. 
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In the audio he is told, "No, the Law requires a system, ground- Here is the section from 
the Code that pertains to system grounding for th^s type of system. Read the section and if ^ou 
still don't understand, get someone to explain it before going on." He looks at the legal require- 
ments and[ presses GO-ON. '$ 
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Back to the problem again, but this time he is given a hint. "To connect the system ground, 
you have to connect the center-tap, terminal number seven, to ground. Connect number seven 
to ground by entering seven and another number to fill in the blanks on the visual display." 

However, not knowing what a center-tap is, he again just presses GO-ON - indicating that 
no System ground is required. In this case, he is repeating his earlier error and the machine 
is set to sense that he is in serious trouble. So it takes him to a frame telling him to get some 
help. 
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"I cannot help you any further*. Find soilieone who can help you with your problem, then 
go on with the lesson." The student nowvgets an explanation of center -taps from his instructor, 
then presses GO-ON, which takes him back to the same problem for another tr^. 
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"To connect the system ground, you have to connect the center -tap, terminal number 
seven, to ground* Connect number seven to ground by entering seven ailji another number to 
fill in the blanks on the visual display," 

• He enters 7 and 1 in the keybosu:*d - resistance grounding the system. 
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"No, Uus'system ground is illegal. The center-t^p must^be coimected directly to earth. 
Pressing GO-ON takes him to the next frame to read the Law again. 



25 

Z3 



4 



§75.701,-2 ApprorH method of KrouadUnc mtUUlc 
(nmet. culnft 2nd other eocloMret xecdTlnc 
powtr from »lQcle-ph»s« UO-220'Tgtt circuit. 
In Injt&nect where tlncle-ofaase ''llO'2au<'TOM cIT' 
cultt are used to (•ed electrical cquipcacat, the only 
methodof icrouadioc UuU will be approved it the coo-« 
nectloa of all metallic (ranet. caslncs and other ea- 
cloturct of such c<)dpcseat to a separate poondlnp 
cosAictor which estabUtb«ta cortlnooas cx>oocctloa 
to a i^rounded center tap of the tratttfonner. « 



110- no Vein AC, Sinflf 
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"Here is the section of the Law that requires the center-tap to be directly groun?ied. Read 
this section, then press GO-ON and try it again.'C He looks at the notes on the right-hand border, 
reads the Law, then .presses GO-ON. 
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"To connect the system ground, connect the center -tap. terminal number seven, to ground." 
Finally he remembers all the requirements. He connects the center-tap, terminal 7, directly 
to groimd, terminal 2. 
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His aliswer takes him to this frame showing his completed .connection and presenting the 
next part df the problem. \ 
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This example shows how this lesson diagnoses and corrects student errors as they occur. 
Of course, few students will niake as many mistakes as were shown above. As soon as the 
student completes the problem cori'ectly^he goes to the next part of the problem. 

There are several significant feature^ in this lesson design. Most importantly, guessing 
IS eliminated. Correct answers alone sallow progress through the lesson. This means that the 
better students spend less time learmng the material than poorer students, but all students have 
shown the same level of skill when they .are done with the lesson* The diagnosis of types of 
errors makes this possible - permitting help with individual problems. Repetitive errors send 
the student to get help from his instructor. Finally, the HELP key lets the student find the in- . 
formation he needs, ana trains him to get that information rather than relying on intuition or 
guesswork. This lesson is designed to help the student proceed through the material at his own 
pace, to remedy errors as they occur, and to develop good habits toward^ safety in mining, as a 
whole - obtaimng information when needed, checking the legality 'of work in progress, and 
making knowledgeable judgements rathei* than hasty guesses. 
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